Transient termination of synaptically sustained spiking by stochastic inputs 

in a pair of coupled Type 1 neurons 
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We examine the effects of stochastic input currents on the firing behavior of two excitable neurons 
coupled with fast excitatory synapses. In such cells (models), typified by the quadratic integrate 
and fire model, mutual synaptic coupling can cause sustained firing or oscillatory behavior which 
is necessarily antiphase. Additive Gaussian white noise can transiently terminate the oscillations, 
hence destroying the stable limit cycle. Further application of the noise may return the system 
to spiking activity. In a particular noise range, the transition times between the oscillating and 
the resting state are strongly asymmetric. We numerically investigate an approximate basin of 
attraction. A, of the periodic orbit and use Markov process theory to explain the firing behavior in 
terms of the probability of escape of trajectories from A. 
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Recent experiments |l5| have shown that the spiking 
patterns of regular spiking and fast spiking neurons in 
the rat somatosensory cortex exhibit Type 1 and Type 
2 behavior, respectively. Such differences were origi- 
nally found by Hodgkin in his investigations of the 
responses of squid axon preparations to applied currents. 
In some cases, the frequency of firing rose smoothly from 
zero as the current increased whereas in others, a train 
of spikes with a non-zero minimal frequency suddenly 
occurred at a particular input current. Cells that re- 
sponded in the first manner were called Class 1 (which we 
call Type 1) whereas cells with discontinuous frequency- 
current curves were called Class 2 (Type 2). Mathe- 
matical explanations for the two types are found in the 
bifurcation which accompanies the transition from rest 
state to the periodic firing mode. For Type 1 behavior, 
a resting potential vanishes via a saddle-node bifurcation 
whereas for Type 2 the instability of the rest point is due 
to an Andronov-Hopf bifurcation; see for example p^ . 

Here we analyze the effects of stochastic inputs on the 
firing behavior of coupled neurons of Type 1. Although 
there have been many studies on single neurons of this 
type, [H, S the effect of noise on systems of coupled 
Type 1 neurons has not been extensively investigated 
[2, y . We identify a novel effect of noise on the firing sus- 
tained by recurrent excitatory synapses in a pair of Type 
I neurons: weak noise effectively terminates the firing by 
destroying the stable limit cycle. Stronger noise can lead 
to intermittent oscillatory behavior. Particularly unex- 
pected are simulations that suggest that such an effect 
is generic and does not depend on the noise model, al- 
though our focus is on Gaussian white noise. We explore 
two analytical approaches for explaining the "inhibitory" 
effect of the noise, one via first-exit time theory and the 



other using moment differential equations. 

The quadratic integrate and fire model and the 6- 
neuron. — Computational models which include de- 
tails of the complex anatomy and physiology of cortical 
neurons are too complicated to analyze mathematically. 
However, we can take advantage of the generic nature (as 
the local normal form of a saddle node bifurcation) of a 
relatively simple neural model that exhibits Type 1 firing 
behavior. This is the quadratic integrate and fire (QIF) 
model [flj for which 

X^{x~XBf +13, (1) 

where x is interpreted as the membrane potential of the 
neuron, xr is its resting value and (3 is the mean input. 
Once the value xc of x is so large that the r.h.s. of (1) 
is positive, it will become infinite in a finite time (of the 
order of l/xc) and then has to be reset to — cxd. The 
upward excursion and resetting constitute a "spike" in 
this model. Problems with infinite values can be avoided 
by applying the transformation x — x^ = tan |, where 6 
takes values in [0, 27r], i.e., on the unit circle when we 
identify and 27r. This yields the 0-neuron model 3, 6] 

^ = l-cos6i + (l + cos6')/3, (2) 
where 6 — n corresponds to a spike of the neuron. Both of 
these equivalent formulations have been used previously 
for simulation and analysis of neural dynamics 0, ITU . 

We consider the case of two coupled identical QIF neu- 
rons i — 1,2 with noise terms as follows Q 

dXi = [{Xi-XRf+(3 + g,sX3]dt + adWi 
[{X2 - xr)^ +P + gsXi]dt + adW2 
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where Xi , X2 are random processes corresponding to the 
membrane potentials of the neurons while X3 {X4) is 
the synaptic input from neuron 2(1) to neuron 1(2). 
In these equations, is the coupling strength between 
the neurons and Wi and W2 are independent standard 
Wiener processes which enter with amplitude a. The 
noise terms represent fluctuations in nonspecific inputs 
to each neuron as well as possibly intrinsic membrane 
and channel noise. The function F is given by F{x) = 
1 + tanh(x — Xth), where Xth characterizes the threshold 
effect of synaptic activation [l^, so the variables X^^X^ 
take values in the interval [0,2]. The corresponding 9- 
neuron equations then are 

de, =(1 - cose, - ia^/2)smei{l + cosei)[(3 + gsXi+2])dt 

+ cr(i + cose,)c;vF, (i = i,2), 

(7) 

where Qi — n corresponds to a spike of neuron i. Note 
that at this spike point, the effect of the noise term 
vanishes. As verified by Gutkin (unpublished), this, to- 
gether with the strictly positive contribution of the term 
1— cos @i, ensures that the spike point 8^ = tt can only be 
passed in the direction of increasing values of Qi. There- 
fore, this model is equivalent to the quadratic integrate 
and fire model with resetting at 00. 

For the purpose of this report we choose a negative 
value for (3 so that each neuron in isolation will not fire 
by itself when its potential is near the resting value xr, 
but only when perturbed beyond a threshold xt- For the 
model described by (3)-(6), without noise, inducing firing 
in one neuron by perturbing it beyond threshold leads 
to sustained firing in both neurons when the coupling 
strength is above the bifurcation value gs — gl- At that 
value, two heteroclinic orbits between the unstable rest 
points where one of the neurons is at xr, the other at 
XT: turn into a periodic orbit of antiphase oscillations. 
We then have two stable attractors, the stable rest point 
where both neurons take the value xr, and the antiphase 
oscillator. We note that the dynamics are equivalent for 
both versions of the model circuit: the QIF and the 6- 
neuron. 

Results and theory. — In the numerical work, the 
following constants are employed as the standard set 
throughout, xr = 0, Xth = 10, = —1, gs = 100 and 
T = 0.25. In our simulations, we reset the state variables 
X\, X2 to the value —xc when they reach or exceed the 
value xc = 20. The initial values of the neural potentials 
are ^i(O) = 1.1, ^2(0) = and the initial values of the 
synaptic variables are ^^3(0) = ^4(0) = 0. Results such 
as those in Figure 1 are obtained. The spike trains of the 
two coupled neurons and their synaptic inputs are shown 
on the left for no noise. The firing settles down to be 
quite regular and the periodic orbit is in part shown in 
the a;2)-plane as the red curve in Figure 2. 

The effects of weak noise on the spike trains are shown 
in the right column of Figure 1. In the top portion an 
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FIG. 1: On the left are shown the solutions of (O-© for two 
coupled QIF model neurons with the standard parameters 
and without noise. Xi and X2 are the potential variables of 
neurons 1 and 2 and X3 and X4 are the inputs to neurons 
1 and 2, respectively. On the right are shown examples of 
trajectories of the potential variables when there is noise, a — 
0.1, in the top two parts and a — 0.2 in the lower two parts. 
Note the absence of spikes in the trial for the larger noise case. 



example of the trajectory for a — 0.1 is shown. Here 
three spikes arise in neuron 1 and two in neuron 2, but 
the time between spikes increases and eventually the or- 
bit collapses away from the periodic orbit. In the ex- 
ample (lower part) for a = 0.2 there are no spikes in 
either neuron. Extensive simulations showed that orbits 
tended to collapse away from the periodic orbit in the 
vicinity of the points Pi and P2, as shown in four trials 
in Figure 2. Here, the red curve depicts the stable pe- 
riodic orbit in the absence of noise and the blue curves 
are trajectories with noise, a = 0.1. These random paths 
always start precisely at the same point in i?'* on the 
periodic orbit - marked as "initial point" . The num- 
ber of orbits completed is a random variable which we 
may quantify using T^, which is the time of occurrence 
of the last spike in neuron 1. Inspection of histograms 
of Pi-values, based on 500 trials, for cr = 0.1 and 0.45, 
shows that the spiking stops after approximately an in- 
teger multiple of the first spike time. Furthermore, as a 
increases, the number of occasions on which no spike was 
generated increases. This is further illustrated in Figure 
3 where the mean of Pl is plotted against a. Hence it 
is clear that noise tends to curtail firing. The theoret- 
ical basis of these plots is outlined in the next section. 
Exit-time and orbit stability. — If a basin of attraction 
for the periodic orbit can be found, then the probability 
that the process with noise escapes from this basin gives 
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FIG. 2: Four examples which illustrate the noise-induced col- 
lapse away (blue paths) from the basin of attraction of pe- 
riodic orbit, denoted by the red curve, in two coupled QIF 
neurons. The parameters are the standard set, with a — 0.1, 
and the initial point is the same in all cases, being on the 
periodic orbit as indicated top left. The departure points are 
located either near Pi or P2. In the top left example there is a 
spike in neuron 2, then a spike in neuron 1 (both clipped) fol- 
lowed by escape from the basin of attraction before a second 
spike can occur in neuron 2. 
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FIG. 3: The mean of the time Tl to the last spike in neuron 
1 versus the noise amplitude. This quantity measures the 
exit time from the basin of attraction of the periodic orbit. 
The 4-dimensional process (Xi, X2, -'i^s, ^4) is initially on the 
periodic orbit. Error bars denote 95% confidence intervals 
(500 trials). 



the probability, in the present context, that spiking will 
cease. Since the system (3)-(6) is Markovian, we may 



apply standard first-exit time theory [17[. Let A be a 



set in (5*^)^ x [0, 2]^ and let 2/1,2/2 be the values assumed 
by 01 and Q2 and let 2/3,2/4 be the values assumed by 
the synaptic input variables X3 and X4 . The probability 
p(2/i: 2/2, 2/3i 2/4) that the process ever escapes from A is 
given by , 

x2 p 

cos 2/1 



CP ^ yd 
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where (2/1,2/2,2/3:2/4) £ and with boundary condition 
that p = 1 on the boundary of A (since the process is con- 
tinuous). If one also adds an arbitrarily small amount of 
noise for X3 and X4 (or considers those solutions of (8) 
that arise from the limit of vanishing noise for X3,X4), 
and uses the positivity of the drift term 1 — cos 6 aX 6 — tt 
where the diffusion coefficient ^(l-|-cos6')^ vanishes, the 
solution of the linear elliptic partial differential equation 
(8) is unique and = 1 so that the process will eventu- 
ally excape from A with probability 1. Hence, the ex- 
pected time /(y) of exit of the process from A satisfies 
= y & A with boundary condition / = on the 
boundary of A. This mean value corresponds closely with 
the expected value of Tl depicted in Figure 3. In fact, for 
small noise, the logarithm of the expected exit time from 
A, that is, the time at which firing stops, behaves like the 
inverse of the square of the noise amplitude Q . When the 
process escapes from A, it has to move into the basin of 
attraction of the stable rest point. With a small probabil- 
ity, noise can eventually also drive the process out of that 
latter basin, so that some intermittent spiking behavior 
may result. Near the bifurcation value gs = 5s, however, 
the situation is not symmetric between the two attrac- 
tors. The width of the basin of attraction of the stable 
rest point is always positively bounded from below; while 
just beyond the bifurcation value, the antiphase oscilla- 
tor basin of attraction is very narrow because it emerges 
from two heteroclinic orbits linking the fixed points - 
the rest-points and the thresholds, and so, noise can rel- 
atively easily drive the dynamics out of it. Numerically 
we identified that the region of easiest escape from that 
basin is near the points Pi and P2 in Figure 2 for the 
given values of the parameters. This in fact, would be 
where the basin is the narrowest. In another approach 
we have investigated the system of differential equations 
for the moments of the system (3)- (6) as given in the 
appendix. Numerical solutions showed that the variance 
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of Xi and X2 suddenly became extremely large in the 
vicinity of the exit-points Pi and P2 of Figure 2. 

Discussion. — We have studied the effect of noise 
in systems of two coupled neurons of Type 1. Since 
the quadratic integrate and fire neurons represent the 
canonical model for type I excitability, our results are 
generic for that whole class of models . We found that 
while coupling can support asynchronous oscillatory 
activity in excitable neurons, noise can transiently 
terminate that sustained spiking (near to the bifurcation 
point where the asynchronous periodic orbit emerges). 
This circuit is a stochastic analogue of the deterministic 
case previously studied by Gutkin et al. (2001) who 
showed that transient synchronization can terminate 
sustained activity. This two-neuron circuit is a minimal 
circuit model of self-sustained neural activity. Such 
activity in the prefrontal cortex has been proposed as 
a neural correlate of working memory l5|. In numerical 
simulations we have previously noted [81] that the tran- 
sitions between the two states can be quite assymetric, 
given that the circuit is close to the bifurcation (i.e. the 
synaptic coupling is near the onset of sustained activity) . 
Obviously for sufficiently weak noise the transition times 
are long: times for both turning off the sustained 
activity and turning it on go to infinity as the strength 
of the noise goes to zero. Strong noise will produce 
intermitent excursions between the two states, possibly 
with comparable transition times. However, for a range 
of noise parameters, depending on the parameters of the 
circuitry (such as the value of the f3 and the synaptic 
time constants), the time to turn off the activity is 
short while the time to turn it back on (by the noise) 
is long. In fact previous simulations (see [81]) have lead 
us to believe that there is an optimal value of the noise 
to turn off the sustained activity without turning it on 
for any length of simulation so that the two transition 
times appear to be on separate time scales, and the 
noise effectively appears to turn off the sustained firing. 
We developed a geometrical interpretation, showing 
that the relative size and the geometry of the basin of 
attraction for the anti-phase oscillation is the key to 
this effect. Simulations hint at a different scaling for 
the mean life time of the sustained firing state and the 
silent state as a function of the noise strength. Hence we 
would speculate that the tuning for the noise dependent 
destruction of the limit cycle stability is evocative of 
stochastic resonance phenomena and may be loosely 
interpreted as a delay of bifurcation by noise. Such 
delays have been previously noted for excitable single 
neurons II6II and more recently for spatially extended 
systems [lOj. 
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Appendix — For the system of 4 stochastic differential equa- 
tions (3)-(6) we may deduce, for small noise, the following 
differential equations for the first and second order moments, 
being the four means, denoted by mi,i = 1,...,4 and the 
10 covariances dj = Cov[Xi, Xj], which includes the 4 vari- 
ances, Vi.i — 1, .... 4. 
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